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1 .  Introduction 

The  second  author  [12]  recently  presented  his  Bound-and-Scan  Algorithm 
for  solving  the  pure  Integer  linear  programming  (IP)  problem, 


maximize  c^x 
subject  to 

Ax  <_  b 
x  >_  0 

x  integer, 


0) 

(2) 

(3) 

(4) 


where  A  is  an  m  x  n  matrix,  b  is  an  m-vector,  and  c  is  an  n-vector. 

The  encouraging  computational  experience  with  the  algorithm  suggests  that 
the  techniques  proposed  in  [12]  deserve  further  attention.  Of  particular 
interest  is  the  extremely  efficient  procedure  used  to  construct  partial 
solutions  for  the  "nonbasic"  variables  (nonbasic  in  the  optimal  linear 
programming  solution),  as  described  in  Section  6.  The  remaining  variables 
are  called  "basic"  variables. 

Given  two  problems  of  similar  size  and  structure,  the  Bound-and-Scan  Algoritnm 
would  generally  be  more  efficient  for  the  problem  with  fewer  basic  variables 
(and  hence  more  nonbasic  variables).  This  observation  leads  very  naturally 
to  the  question:  Is  It  possible  to  restructure  the  problem  initially  so  that 
the  restructured  problem  has  fewer  basic  variables?  The  theory  of  equivalent 


\ 
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integer  programs,  Introduced  by  6:  Bradley  [2]  provides  a  partial 
answer  to  this  question.  This  theory  says  that  there  exists  an  equivalent 
problem  In  which  the  number  of  basic  variables  is  generally  less  than 
or  otherwise  equal  to  the  number  of  basic  variables  in  the  original  problem¬ 
solving  an  equivalent  problem  with  fewer  basic  variables  Is  one 
possibility  for  Improving  upon  the  Bour.d-and-Scan  Algorithm.  Another  would 
be  to  extend  to  the  basic  variables  the  efficient  bounding  procedure  for 
constructing  partial  solutions  for  the  nonbasic  variables.  These  two 
Ideas  provide  the  primary  motivation  for  the  basic  enumeration  scheme  of 
the  Accelerated  Bound-and-Scan  Algoilthm  to  be  described  below 

Certain  of  the  linear  programming  constraints  (2,3)  which  hold 
with  equality  at  are  called  binding  constraints  To  define  these, 

recall  that  before  the  simplex  algorithm  is  applied  to  the  linear  program 
(1,2,3),  the  inequality  constraints  (2)  are  first  transformed  to  equality 
constraints 


Ax  t  Is  --  b 


by  the  addition  of  slack  variables  s-  The  binding  constraints  consist  of 
those  constraints  among  (2)  whose  slack  variables  are  nonbasic  in  the 
optimal  linear  programming  solution,  and  those  among  (3)  which  correspond 
to  nonbasic  variables  at  x^-  Thus,  exactly  n  of  the  (n*m)  constraints 
(2,3)  are  binding  constraints  Let  these  binding  constraints  be  represented  as 


b-j  +  A-jX  0. 


(5) 
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The  other  m  constraints  are  called  non-binding  constraints  and  will  be 
represented  as 

t>2  +  ^  0.  (6) 

The  Integer  program  over  the  cone  (the  "cone  problem")  Is  the 
problem  obtained  from  the  Integer  programming  problem  by  deleting  the 
nonbinding  constraints  (6).  The  cone  problem  is  therefore 

maximize  c^x  (7) 

subject  to  b-|  +  A^x  _>  0 

x  integer  . 

When  the  basic  enumeration  scheme  is  used  to  solve  the  integer 
program  over  the  cone,  the  algorithm  will  be  called  the  "cone  algorithm." 

It  will  be  shown  that  the  cone  algorithm  Is  mathematically  equivalent 
to  the  Bradley-Wahi  enumeration  algorithm  [3J  for  the  corresponding 
cone  problem. 

The  feasible  region  for  the  cone  problem  is  generally  larger  than 
the  feasible  region  for  the  Integer  programming  problem.  Any  algorithm 
designed  to  solve  the  more  restricted  problem  must  consider  the  additional 
constraints  present  in  the  integer  program.  Three  techniques  are  developed 
in  Section  8  for  dealing  with  these  constraints.  The  first  of  these 
techniques  Is  the  standard  device  of  considering  only  values  of  variables 
between  fixed  upper  and  lower  bounds.  The  bounds  are  calculated  once  at 
the  outset  and  are  based  on  all  the  constraints  of  the  original  problem 
rather  than  on  just  the  cone  constraints.  The  second  method  of  dealing 
with  the  additional  constraints  of  the  IP  problem  is  to  use  a  scanning 
procedure  whenever  an  infeasible  solution  within  the  cone  is  generated. 

The  scanning  procedure  allows  the  algorithm  to  "skip  over"  possibly  many 
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other  Infeasible  solutions  In  the  basic  enumeration  scheme*  The  third 
technique  Is  a  means  of  recognizing  and  eliminating  redundant  constraints* 
Constraints  which  must  be  considered  at  the  start  of  the  algorithm  may 
become  superfluous  as  Improved  solutions  to  the  IP  problem  are  found* 

When  the  cone  algorithm  Is  supplemented  by  these  three  techniques, 
the  resulting  algorithm  will  be  called  the  "skeleton  version"  of  the 
Accelerated  Bound-and-Scan  Algorithm.  Additional  options  for  the  algorithm 
also  are  available.  In  particular,  conditional  bounds  on  variables  might 
be  calculated  by  techniques  suggested  In  [12]  or  In  [5,  Ch-  VII]  Surrogate 
constraints  [7]  might  be  very  useful  In  determining  the  feasibility  of 
solutions  generated  within  the  cone. 

As  In  [12],  the  two  main  assumptions  used  by  the  Accelerated  Bound- 
and-Scan  Algorithm  are  first,  that  the  optimal  noninteger  solution 
to  (1,2,3)  Is  unique,  and  second,  that  a  good  feasible  integer  solution 
x<F>  to  (1,2, 3, 4)  has  already  been  Identified.  Efficient  heuristic 
procedures  for  obtaining  x^  are  aval  1  able  [13]  when  (2,3)  possess 
interior  points.  Otherwise,  the  system  of  Diophantine  equations  must 
first  be  solved  to  eliminate  the  equality  constraints  An  additional 
assumption  made  here  Is  that  all  elements  of  A,b  and  c  are  integer-valued. 

In  Section  2  the  theory  of  equivalent  integer  programs  Is  reviewed. 
The  fundamental  congruence  system  used  by  the  algorithm  Is  derived  In 
Section  3,  Section  4  presents  the  basic  enumeration  scheme,  and  Section  5 
outlines  the  cone  algorithm  In  Section  6  the  special  computational 
property  of  the  nonbaslc  variables  Is  displayed,  and  in  Section  7  the  cone 
algorithm  is  compared  with  the  Bradley-Wahi  cone  algorithm.  Section  8 
presents  the  skeleton  version  of  the  Accelerated  Bound-and-Scan  Algorithm, 
and  computational  experience  is  gi  ,-en  in  Section  9,  followed  by  conclusions 
1  r.  Section  10. 
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2..  Equivalent  Integer  Programs  and  the  Cone  Problem 

Bradley  [2]  has  shown  that  the  Integer  programming  problem  Is 
equivalent  to  Infinitely  many  other  Integer  programming  problems  of  the 
form 

maximize  cTe  +  (cTK)y  (8) 

subject  to  ( AK )y  b  -  Ae 

-K  y  i  e 

y  Integer, 

where  K  Is  an  n  x  n  unlmodular  matrix  (a  square  integer  matrix  whose 
determinant  equals  plus  or  minus  one),  and  e  is  an  integer  n-vector. 
Problem  (8)  may  be  solved  instead  of  problem  (1,2, 3, 4).  The  correspondence 
between  the  solutions  x  and  y  Is  given  by 

x  =  Ky  +  e  (9) 

and 

y  »  K_1(x-e).  (10) 

The  following  results  are  fundamental  In  the  selection  of  the 
equivalent  problem  (8)  to  be  solved. 

Theorem  1  (Hermlte  [2]):  Given  an  n  x  n  Integer  matrix  C  of  full 
rank,  there  exists  an  n  x  n  unlmodular  matrix  K  such  that  CK  Is 
lower  triangular  with  positive  diagonal  elements,  and  each  off-diagonal 
element  Is  nonpositive  and  strictly  less  In  absolute  value  than  the 
diagonal  element  In  Its  row. 

CK  Is  called  the  Hermlte  normal  form  of  C. 
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Theorem  2  (Bradley  [2]):  The  Integer  programming  problem  (1,2, 3, 4) 

Is  equivalent  to  an  Integer  programming  problem  such  that  In  the  new 
problem  the  n  x  n  coefficient  matrix  of  the  binding  constraints  Is  In  Hermlte 
normal  form  and  each  element  of  the  constant  column  of  the  binding  constraints 
Is  nonnegative  and  strictly  less  than  the  corresponding  diagonal 
element  of  the  coefficient  matrix. 

The  equivalent  problem  mentioned  In  Theorem  2  Is  of  the  form, 

maximize  c^e  +  (c^K)y  (11) 

subject  to  (b^+A^e)  +  A^Ky  >.  0 

(bg-^e)  +  AgKy  ±  0 

y  integer, 

where  A^K  Is  the  Hermlte  normal  form  of  A^. 

In  the  new  variables  y  the  cone  problem  Is 

maximize  cTe  +  (cTK)y  (12) 

subject  to  (b^+A^e)  +  (A^K)y  >_  0 

y  integer. 

There  are  reasons  for  choosing  K  so  that  A^K  Is  the  Hermlte 
normal  form  of  A^.  The  matrix  A^  Is  singled  out  because  In  general  the 
binding  constraints  are  the  constraints  most  likely  to  be  violated  by 
an  Integer  solution  In  the  vicinity  of  the  optimal  linear  programming 
solution.  In  the  Accelerated  Bound-and-Scan  Algorl thm,  the  binding  constraints 
serve  as  a  filter  for  examining  possible  solutions.  It  may  therefore 
be  desirable  to  select  the  equivalent  problem  so  that  the  binding  constraints 
have  as  "simple"  a  ^orm  as  possible.  The  lower  triangular  property  of 
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the  Hermite  normal  form  makes  It  feasible  to  apply  either  the  Fourler- 
Motzkln  elmlnatlon  proceaure  suggested  by  Bradley  and  Wahl  [3]  or  the 
Accelerated  Bound-and-Scan  Algorithm  to  be  described  below.  Another 
appealing  property  of  the  Hermite  normal  form  Is  that  typically  many  of 
the  diagonal  elements  of  the  Integer  matrix  A^K  will  be  unit  elements. 

Each  unit  element  along  the  diagonal  of  A^K  corresponds  to  a  simple 
ncnnegatl vlty  constraint  y^>0,  and  hence  to  a  nonbasic  variable  In  the 
optimal  linear  programming  solution.  If  the  rows  of  Aj  are  initially 
ordered  so  that  the  binding  nonnegativity  constraints  of  the  original 
problem  precede  the  binding  functional  constraints,  the  equivalent  cone 
problem  (12)  will  have  at  least  as  many  nonnegativity  constraints  (and 
hence  nonbasic  variables)  as  the  original  cone  problem,  and  usually 
many  more.  This  ordering  of  the  rows  of  A1  will  be  assumed  (as  the 
most  convenient  one)  for  the  algorithm. 

The  phenomenon  of  many  unit  elements  along  the  diagonal  of  A^ 

Is  consistent  with  a  well  know  Interpretation  of  the  procedure  for 
obtaining  the  Hermite  normal  form  of  a  matrix.  The  procedure  may  be 
viewed  as  successive  applications  of  the  Euclidean  algorithm  for  finding 
the  greatest  common  divisor  (gcd)  of  two  integers.  For  example, 
the  first  diagonal  element  of  the  Hermite  normal  form  A-jK  is  the 
gcd  of  the  n  integers  in  the  first  row  of  A^ .  In  general,  the  jth 
diagonal  element  of  A^K  is  the  gcd  of  (n-j+1)  integers.  The  following 
simple  result  may  make  plausible  the  occurrence  of  unit  elements  along 
the  diagonal  of  the  Hermite  normal  form  A^K  if  the  elements  of  A^ 
are  generated  randomly.  The  notation  (k^,***»K^)  denotes  the  gcd  of 
kl  *  *  *  *k t  *  ancl  den°tes  the  greatest  integer  less  than  or  equal 

to  z. 
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Theorem  3  Let  k.  be  Independent,  identically  distributed  random 

1  L 

variables  with  the  probability  mass  function 


P(kj  ■  s)  ■  jj-j-  s  ■  ±1,  ±2,«..,±m, 
for  all  j  ■  1 ... . ,t.  Then 

P((kj . kt)  -  1)  >  1  -  ^;2  ([m/O/m)1. 


Proof 


P((k1 . kt) 

Ii?8 

P ( (kj » • • • ,k^)  s  1 ) 

i  v  m 
—  ‘•1*2 

P(i  divides  every 

«  1  -  T  m 

1  “1=2 

C [rn/1 3/m) 1 

(13) 


-,t) 


Consider  as  an  example  the  case  where  m  =  6  and  t  ~  5  Then  by 
(13)  the  probability  that  five  randomly  generated  integers  have  gcd 
equal  to  one  Is  at  least  .96 
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3,  The  Fundamental  Congruence  System 

If  the  objective  function  value  z  Is  treated  as  a  parameter, 

the  equivalent  cone  problem  (12)  can  be  replaced  by  the  Inequality  system 

\ 

In  Integer  variables  y-|.<..,yn:  1 


9lyl  +  92*2  +;‘*+  Vn-2  *  c  e 
h11yl 


-e1 


h21yl  +  h22y2 


~  e2 


(14) 


hnly1  +  hn2y2  +  +  hnnyn  ^  V 


where 


h1j  =  <AlK)1j 

^1  ~  ^1+A1®^1 
9j  '  <CTK)j 


l.j 

i 

j 


1 » « -  ■  ,n  i 
1 » « >  ^  »n , 
1  >  •  *  ■  »n  • 


The  Accelerated  Bound-and-Scan  Algorithm  Is  based  on  system  (i4; 
For  a  fixed  value  of  z  corresponding  to  a  known  feasible  solution, 
tne  (n+1)  constraints  of  (14)  define  an  n-slmplex  S  (in  Euclidean 
n-space)  In  which  the  optimal  solution  to  the  Integer  programming  problem 
must  lie.  The  n-slmplex  5  Is  a  convex  set,  and  therefore  every  point 
In  S  can  be  expressed  as  a  convex  combination  of  the  vertices  y^ 

(1  =  G,,,.,n)  of  S.  That  is,  for  every  y  in  S  there  exist 


9 


unique  extreme  point  weights  (1  s  0,1, such  that 

i 

y *  Z("0  p,y(1)  <'» 

Ii"o  -i  -  1 

p|  i  0  1  ■  0,1,”  •  ,n. 

An  equivalent  representation  would  be 

y  'y(0)  ♦If^.1(y(1)-y(0))  06) 

i 

I 

>_0  1  =  1  ,•  •  •  ,n. 

The  Integer  requirement  on  y  is  satisfied  by  considering  only 

\ 

extreme  point  weights  p^,”*,p  which  satisfy  the  congruence  system 

y<0>  +  1,1]  ci(y<1)-y(0))  =  o  (modi,  07) 

It",  *i  i  1 


Pi  iO 


i  *  1  ,* 4  4 ,n. 


Lemma  1  The  coefficient  matrix  of  (17)  is  lower  triangular  with 
strictly  positive  diagonal  entries.  That  is,  (17)  is  of  the  form: 

^11  'Vo,'\ 


/d,\ 


VV 


',1 


where  Bir°  for  1  =  1 


,n. 


B 


nn. 


=  0  (mod  1 ) 


ny  \^pr J 

I,  Vi  i  > 

p^^_0  1  =  1 , . . .  ,n  i 


(18) 
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Proof  The  linear  programming  solution  y 


is  found  by  dropping  the 


(0) 


objective  function  constraint 


Vl  +  V2  +  *■'  +  Vn^z  ■  c  e 

from  (14)  and  solving  the  simultaneous  equation  system 


hllyl 

h21yl  +  h22y2 


=  6- 


(19) 


hnlyl  +  +  *•'  +  hnnyn  =  en 

Since  (19)  is  a  lower  triangular  equation  system,  the  first  j  components 
of  y^°)  are  uniquely  determined  by  the  first  j  equations 

*  J 

of  (19). 

The  extreme  point  y^,  1  *  l,--*,n,  is  the  unique  solution  to  the 
equation  system 


hllyl 


=  6 


1 


hi-l,lyl  +  +  h1-l,i-l  yi-l 

Vi 

hi+i,iyi  + 


=  6^  (20) 


+  Vn  =  Z‘C  e 

+  h1+l,1+lyi+l  =  6i+l 


hmyi  +  ■" 


+  hnnyn=  V 


obtained  from  (19)  by  replacing  the  i^  equation  of  (19)  by  the  equation 


Vi 


+  •••  +  Vn  =  z  •  c  e  • 
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Since  the  first  (i-1)  equations  of  (20)  form  a  lower  triangular  system 
Identical  with  the  first  (1-1)  equations  of  (19),  (yi^-y!0^)  =  0  for 
all  j  =  !.•••, 1-1,  so  the  constraint  matrix  of  (17)  Is  lower  triangular. 

To  show  that  B^O,  It  is  sufficient  to  show  that  p.  Is  an 
increasing  function  of  yi .  From  equation  (44)  In  [12],  It  follows  that 


pi =  Vr6i)/Qi  *  (Wv 

where 

Qi  !  Ij-i  Vj*’  -  v 

By  the  construction  of  (14),  ^.>0,  and  by  Lemma  3  in  [12],  Q  >0. 
Therefore  B^>0,  and  the  proof  of  Lemma  1  Is  complete. 

It  should  be  pointed  out  that  the  congruence  system  (18)  is  not 
unique-  Each  of  the  n!  orderings  of  the  rows  of  yields  a 
(possibly)  different  system  (14),  which  in  turn  determines  (18).  The 
ordering  of  the  rows  of  may  play  an  important  role  in  the 
computational  efficiency  of  the  algorithm. 

4.  The  Basic  Enumeration  Scheme 

The  basic  enumeration  scheme  for  the  Accelerated  Bound-and-Scan 
Algorithm  is  a  systematic  way  of  enumerating  implicitly  all  solutions 
to  congruence  system  (18),  and  hence  all  lattice  points  within  the 
n-slmplex.  Such  an  implicit  enumeration  scheme  may  be  used  to  solve 
the  cone  problem.  The  "cone  algorithm"  proceeds  by  considering 
sequences  of  partial  solutions  to  system  (18). 
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An  "eligible  partial  solution"  through  variable  pj  Is  a  specification 
of  the  values  of  p,,***^.  which  satisfies 

I  '  J 


0  i  p1  i  p1  1  =  1  ,  j- 


The  term  ^  is  an  upper  bound  on  the  maximum  weight  which  may  be  placed 
on  the  i**1  extreme  point  and  still  yield  a  solution  which  satisfies 
both  the  binding  and  nonbinding  constraints.  In  general  p^<_l , 
and  p.<l  if  the  ith  extreme  point  violates  a  nonbinding  constraint. 

For  the  cone  problem  p..  =■  1  for  all  i  =  !,••*, n  since  the  nonbinding 
constraints  are  not  present  In  the  problem.  The  determination  of  the  p^ 
is  discussed  in  Section  8  Eligible  partial  solutions  through  p^  are 
called  "completions,"  for  they  completely  specify  a  lattice  point 
within  S. 

Suppose  an  eligible  partial  solution  (pf,**  »p£_-|)  through 
pk_1  has  been  specified.  The  algorithm  must  determine  by  some  procedure 
whether  there  exists  a  value  for  pk  such  that  (p^,*  -  *  ,pj^_1  ,pk)  is 
an  eligible  partial  solution  through  pk-  This  procedure  is  called  a 
"forward  step"  in  the  algorithm.  If  f  denotes  the  fractiona1  part  of 

VIm  1-"-- 

f  ■  dk 4  m=]  v*  -  tvift  •  <22> 
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Pk  must  be  chosen  to  satisfy 


f  +  Bkkpk  =  0  (mod  1) 

(23) 

*  +  i>k  i' 

(24) 

°iPk  i  v 

(25) 

Consider  first  the  Integer  restriction  (23),  and  let  t  denote  the 
smallest  value  pk  may  take  on  and  still  satisfy  (25).  If  f  =  0, 
then  pk  £  0  satisfies  (23);  clearly  t  a  0  In  this  case.  Recall 
from  Lemma  1  that  Bkk>0.  If  0<f<l,  then  t  must  be  chosen  so 
that  f+Bkkt  =  1.  Therefore 


t  = 


if  0  <  f  <  1 

If  f  «  0. 


(26) 


From  (23)  the  only  possible  values  pk  can  take  on  ,  given  the  eligible 
partial  solution  (pf,*  •  •  ,p£_^ ) ,  are 


Pk  ■  t,t  +  l/Bkk,-*’,t  +  r/BRk  ,  (27) 

where  r  Is  the  largest  Integer  such  that 

‘ +  r/Bkk  i  h  ■ 

The  algorithm  sets  p k  at  t  and  checks  conditions  (24)  and 
(25).  If  either  (24)  or  (25)  Is  violated.  It  Is  obvious  that  no  larger 
value  of  pk  would  satisfy  these  conditions,  and  hence  there  can  be 
no  completion  for  the  partial  solution  (pf,- • • >p£_i) •  The  algorithm 
would  then  backtrack  to  search  for  a  new  eligible  partial  solution 
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through  pk_.|  by  resetting  pk_j  at  pj^+l/B^  k_-j  and  checking 
simply  whether 

£l  of  <28> 

pk-l+  1/Bk-1  ,k-l  -  pk-l  * 

Notice  that  If  the  terms  1/B^  (i  =  l,...,r.)  are  stored,  the  partial 
sum  of  extreme  point  weights  can  be  updated  by  only  an  addition  and/or 
a  subtraction  each  time  a  forward  or  a  backtrack  step  is  made. 

Suppose  pk  =  t  satisfies  conditions  (24)  and  (25),  so  that  an 
eligible  partial  solution  through  variable  pk  has  been  found.  The 
algorithm  then  attempts  to  construct  an  eligible  partial  solution  through 
pk+j  and  continues  the  forward  steps  until  either  a  completion  within 
the  n-slmplex  has  been  found  (an  improved  solution),  or  an  eligible 
partial  solution  through  the  next  variable  cannot  be  found.  In  the 
latter  case  the  algorithm  backtracks  until  the  next  eligible  partial 
solution  is  found  before  starting  the  forward  steps  again.  When  the 
algorithm  backtracks  to  p^,  and  no  new  eligible  partial  solution 
through  p^  exists,  the  algorithm  terminates. 

The  integer  programming  problem  may  be  posed  (see  Theorer.i  2  in  [12]) 
as  the  problem  of  finding  the  feasible  lattice  point  which  places  the 
greatest  weight  on  the  extreme  point  x^.  If  a  completion  has  been 
generated,  it  must  be  checked  for  feasibility  in  the  general  integer 
programming  problem  against  the  nonbinding  constraints.  This  process 
is  discussed  in  detail  in  Section  8.  Since  there  are  no  nonbinding 
constraints  in  the  cone  problem,  every  completion  is  a  feasible  completion  for 
the  cone  problem.  In  either  problem,  once  a  feasible  completion  has  been  found, 
the  algorithm  backtracks  to  p  ^  Every  subsequent  solution  generated  by 
the  algorithm  is  required  to  have  a  larger  objective  functi n  value  than 
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that  of  this  Improved  solution.  A  necessary  condition  for  any  partial  solution 
(p*»  •••Pj)  t0  be  an  eligible  partial  solution  Is  that 

i.  ) »  (29) 

where  (1-^^p^)  Is  the  value  of  pQ  for  the  best  feasible  solution 
(p^ , . . .  ,pn )  known  at  the  current  stage  of  the  algorithm.  Condition 
(29)  replaces  the  condition 


in  the  definition  of  an  eligible  partial  solution  once  a  feasible 
completion  (p, .....p^)  has  been  found. 


5  The  Cone  Algorithm 

The  cone  algorithm  is  the  basic  enumeration  scheme  applied  to  the 


Integer  program  over  the  cone.  Since  p.  3  1  (j  3  1 . n)  In  the  cone 

sJ 

problem,  the  condition  PjiPj  is  superfluous  and  Is  not  used  in  the 
step-by-step  description  given  below. 


Outline  of  Cone  Algorithm 

Step  1.  Set  B*  3  1/Bj ^  for  j  =  l,...,n.  Set  Best  =1,  Sum  =  0, 

k  =  1,  and  go  to  Step  3. 

Step  2.  Reset  k  a  k+1.  If  k>n,  go  to  Step  8. 

Step  3  Let  f  be  the  fractional  part  of  d^+^“|  p ^ . 

Step  4.  If  f  =  0,  set  pk  =  0  and  go  to  Step  2.  Otherwise  set 

»k  = 

Step  5.  Set  Suml  =  Sum  +  p^. 

Step  6.  If  Suml  _>  Best,  go  to  Step  7.  Otherwise  reset  Sum  =  Suml  and 

go  to  Step  2. 
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Step  7.  Reset  k  ■  k-1.  If  k  =  0,  stop.  Otherwise  reset  Sum  =  $um-pk 

and  pk  »  pk+B£.  Set  Suml  »  SunH-Pk,  and  go  to  Step  6. 

Step  8.  An  Improved  completion  has  been  found.  Store  the  solution 

(p-j  *  *  *  *  *on)  ♦  Reset  k  =  n,  Sum  «  Sum-pn,  and  Best  *  Ij^iP  j  ~ 

Go  to  Step  7. 

6 „  A  Special  Property  of  the  Nonbaslc  Variables 

Assume  the  yk  (k  =  l,...,n)  are  ordered  so  that  the  first 
n^  variables  correspond  to  nonnegativity  constraints  in  the  equivalent 
cone  problem  (12).  Each  of  the  yk  (k  *  l,...,n^)  would  be  nonbaslc  in 
the  linear  programming  solution,  and  as  noted  In  [12],  each 
yk  (k  -  l,...,nj)  has  the  value  zero  at  all  extreme  points  y^  of  the 
n-slmplex  except  one  which  Is  designated  y^.  That  Is,  yj^  r  0  for 
all  1  =  0,1, ...,n,  1  f  k,  and  y£k)>0.  An  immediate  consequence  of 
this  property  is  that  the  coefficients  of  the  first  n1  rows  of  congruence 
system  (18)  have  the  following  special  form.  For  k  =  l,...,n^, 

dk  =  0  (30) 

B  = 

°kk  yk 

Bkj  =  o  J  =  1,'**,k_1 

Therefore 

c  k  ~  yk/Bkk  k  =  1 . V 

Compare  this  expression  with  (27).  If  l^.k<_n^ ,  the  fractional  part  f 
of  (22)  is  zero,  so  by  (26)  t  =  0,  and  (27)  reduces  to  (31). 
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From  a  computational  point  of  view,  the  essential  difference 
between  those  extreme  point  weights  p ^  which  are  associated  with 
nonbaslc  variables  and  those  which  are  not  Is  that  for  the  former 
the  fractional  part  Is  knownto  be  zero,  whereas  for  the  latter  f 
must  be  calculated.  The  calculation  of  f  at  each  forward  step 
Is  by  far  the  most  expensive  part  of  the  cone  algorithm,  and  should 
be  avoided  whenever  possible.  Given  the  special  property  (31), 

Step  3  of  the  Cone  Algorithm  Outline  should  therefore  be  revised  to 
read: 

Step  3'.  If  k<n,,  set  pk  =  0  and  go  to  Step  2.  Otherwise 
let  f  be  the  fractional  part  of  c*|c+[^]Bk1  P1  • 

This  technique  Is  equivalent  to  the  procedure  for  constructing  partial 
solutions  for  the  nonbasic  variables  in  the  original  Boond-and-Scan  Algorithm. 
Thus  the  goal  of  extending  the  efficient  bounding  procedure  for  the  nonbaslc 
variables  to  the  basic  variables  as  well  as  been  attained  -  with  the  one 
essential  computational  difference  described  above 
7,  Comparison  with  the  Brad ley -Wahl  Cone  Algorithm 

The  implicit  enumeration  algorithm  for  the  cone  problem  devised 
by  Bradley  and  Wahl  [3]  is  also  based  on  (14).  To  this  system  Bradley 
and  Wahl  apply  the  Fourier-Motzkin  elimination  method,  elminating  the 
variables  In  the  order  yn,yn_^,  ...y^.  As  a  result  of  this  elimination 
procedure,  conditional  upper  and  lower  bounds  on  each  variable  (with 
respect  to  the  cone)  may  be  calculated  relatively  easily.  The  continuous 
upper  bound  on  y^ ,  given  that  the  first  (i-1)  variables  are  fixed  at 
y T ,  - . -  .y  T_ i »  Is  a  linear  function  U^(')  of  z.yjv  . . •  The 
conditional  lower  bound  is  a  linear  function  L^(*)  of  only 

y?*-  ->y*_r 
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Suppose  that  correspond  to  nonnegativity  constraints 

In  the  equivalent  cone  problem.  It  Is  possible  to  show  for  i^n,  that 

i 

U^-)  can  be  calculated  from  __ i ( • ) »  using  only  a  fixed  number  of 
arithmetic  operations  Independent  of  1,  and  that  ( * )  i  0.  For 
1  ■  n,+l,...,n,  there  appears  to  be  no  way  to  reduce  the  number  of 
multiplications  and  additions,  2(1-1),  required  to  compute  U^*) 
and  L.j  ( • )  • 

It  Is  now  possible  to  show  that  the  cone  algorithm  and  the  Bradley- 
Wahl  algorithm  are  mathematically  equivalent  in  the  sense  that  they  will 
generate  the  same  sequence  of  eligible  partial  solutions  for  a  given 
cone  problem  (14). 

There  is  a  one-to-one  correspondence  between  partial  solutions  In 
variables  pj,...^  and  partial  solutions  In  variables  y^,...,y((. 

An  eligible  partial  solution  In  either  variable  system  represents  a 
lattice  point  within  the  k-slmplex  formed  by  the  projection  of  the 
n-simplex  onto  the  space  of  the  first  k  variables  y^,...,yk- 

Assuming  the  same  ordering  of  the  yk  variables  In  each  algorithm, 
it  will  be  shown  that  eligible  partial  solutions  are  constructed  In  the 
same  order  In  both  algorithms.  Consider  first  the  forward  step.  Assume 
that  the  algorithms  have  each  constructed  an  eligible  partial  solution 
through  variable  k  which  corresponds  to  the  same  lattice  point  In  the 
k-slmplex.  Each  algorithm  attempts  to  construct  an  eligible  partial 
solution  through  variable  (k+1)  by  setting  variable  (k+1)  at  Its 
calculated  lower  bound  with  respect  to  the  projected  (k+1)  simplex. 

By  the  proof  of  Lenina  1,  is  an  Increasing  function  of  y^  . 

Therefore,  the  lower  bound  value  for  must  correspond  to  the  lower 

bound  value  for  yk+^,  and  the  partial  solutions  generated  by  the  algorithm 
represent  the  same  lattice  point.  Next,  consider  the  backtrack  step. 
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Wiien  the  Bradley-Wahl  algorithm  backtracks  to  yk,  It  Increases  yk  to 
(yk+l),  which  Is  equivalent  to  Increasing  pk  to  (pk+B£)  as  In  Step  7 
of  the  cone  algorithm.  Thus,  the  cone  algorithm  and  the  Bradley-Wahl 
algorithm  are  mathematically  equivalent. 

The  computational  effort  required  by  each  algorithm  will  be 
compared  next.  Since  partial  solutions  are  constructed  In  the  same 
order.  It  1$;  sufficient  to  compare  the  work  required  on  forward  and 
backtrack  steps.  The  two  algorithms  seem  to  require  the  same 
computational  effort  on  forward  and  backtrack  steps  involving  pk  for 
k<n^.  For  k>n^  the  Bradley-Wahi  algorithm  has  the  advantage  In  the 
backtrack  step  because  It  needs  only  to  reset  yk  at  yk+l  and  check 
whether  the  upper  bound  Uk  has  been  violated.  The  cone  algorithm, 
on  the  other  hand,  requires  another  two  additions  In  Step  7  to  adjust 
Sum  besides  the  addition  required  to  reset  pk  at  pk+B£. 

However,  the  cone  algorithm  Is  superior  on  the  more  expensive 
forward  steps.  The  Bradley-Wahl  algorithm  requires  2(k-l)  multiplications 
and  additions  on  a  forward  step  to  calculate  Lk  and  Uk.  Lk  Is  calculated 
to  determine  the  value  at  which  yk  should  be  set,  and  Uk  is  needed 
to  decide  whether  this  value  of  yk  results  in  a  eligible  partial 
solution.  The  cone  algorithm  uses  k  multiplications  and  additions  to 
find  the  lower  bound  for  pk  and  verify  whether  it  results  In  a  eligible 
partial  solution.  Note  that  the  total  number  of  forward  steps  must 
equal  the  total  number  of  backtrack  steps  The  two  algorithms  therefore 
seem  to  be  roughly  comparable  in  computational  effort  needed  to  solve 
the  cone  problem. 

It  should  be  emphasized  at  this  point  that  the  cone  problem, 
because  of  Its  fewer  constraints  and  simpler  form,  is  easier  to  solve 
than  the  original  Integer  programming  problem  (1,2, 3, 4).  Furthermore, 
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the  Bradley-Wahl  algorithm  deals  only  with  the  cone  problem.  The  Accelerated 
Bound-and-Scan  Algorithm  has  several  features  which  enable  It  to  deal 
effectively  with  the  nonbinding  constraints,  and  therefore  with  the 
original  Integer  program. 

One  of  these  features,  the  scanning  procedure,  uses  to  advantage 
the  unit  coefficient  on  the  variable  In  the  relationship 

1,1,0,  <  1  (32, 

among  pj,...,p  .  The  upper  bounds  and  estimates  of  computational  effort  given  in 
a  companion  paper  [4]  are  also  derived  using  (32).  Although  It  might  be  possible 

to  perform  the  same  type  of  analysis  In  variables  y^ . yn,  the  work 

is  simplified  by  the  unit  coefficient  property  of  (32).  Certainly 
the  scanning  procedure  is  more  efficient  because  of  this  property. 

8.  The  Skeleton  Version  of  the  Accelerated  Bound-and-Scan  Algorithm 

Sine  the  n-slmplex  S  Is  determined  by  only  the  binding  constraints 
and  the  additional  objective  function  constraint  in  (14),  S  may  include 
points  which  violate  a  nonbinding  constraint,  and  are  therefore  not  feasible 
for  the  original  Integer  programming  problem  (1,2, 3, 4).  To  exclude 
from  consideration  some  (but  not  necessarily  all)  of  these  infeasible 
points,  upper  bounds  on  the  extreme  point  weights  may  be  found 
by  linear  programming  or  by  ad  hoc  methods  suggested  in  [12] . 

The  addition  of  upper  bounds  on  the  p^  is  one  of  three  techniques 
in  the  "skeleton  version"  of  the  Accelerated  Bound-and-Scan  Algorithm  for 
dealing  with  nonbinding  constraints.  The  second  technique  is  a  scanning 
procedure.  Suppose  a  completion  (p^,...,p*)  which  satisfies  all  the 
conditions  In  (21)  has  been  generated  by  the  algorithm  If  (p*,..-,p*) 
satisfies  the  nonbinding  constraints,  a  new  improved  solution  has  been 
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found.  If  not,  the  algorithm  could  proceed  by  generating  the  next  completion  | 

according  to  the  enumeration  scheme.  However,  if  the  current  completion 

violates  a  certain  nonbinding  constraint,  there  Is  a  good  chance  this  \ 

-i 

constraint  will  also  be  violated  by  the  next  several  completions  that  would  be  j  i 

generated  by  the  enumeration  scheme.  The  purpose  of  the  scanning  procedure  is  i  i 

i  i 

to  determine  the  next  eligible  partial  solution  which  can  possibly  lead  to  a  feasl 
ble  completion,  so  that  the  enumeration  scheme  can  be  restarted  from  that  point. 

The  m  nonbinding  constraints  (9)  can  be  represented  In  the 
pj  variables  through  changes  In  variables  given  by  (6)  and  (16)  as 

I,",  -A2K<y(1)-y(0))l>,  «  -(b2.A2e+A2Ky(0)).  (33) 

Let 

III,  V(iT  (34! 

be  any  one  of  the  m  nonblndlng  constraints,  and  let  (pf,...,p*)  be  a 
completion  which  has  been  found  to  violate  (34).  Then  the  scanning  procedure 
may  be  suirmarlzed  as  follows.  (In  Step  7  of  the  outline,  the  notation 
<t>  designates  the  smallest  Integer  greater  than  or  equal  to  t.) 

Outline  of  the  Scanning  Procedure 

Step  1.  Set  k  *  n 

Step  2.  Set  y  *  arg  T,.  If  T  <0,  go  to  Step  5. 

1  “K  i «  •  •  jil  1  Y 

Step  3.  If  p If  <_  T,  go  to  Step  3. 

Step  4.  Reset  k  *  k-1.  If  k  =  0,  algorithm  terminates.  Otherwise, 
go  to  Step  2. 

Step  5.  If  +  (l-Z^lj  pf)  Ty>T,  go  to  Step  4. 


. . .  a*™  Jt 


Step  7.  Set  u*  =  (T-^lJ 

Set  r  -  <(u*-p£)3kk>  and  reset  p£  ='  pk+r/Bkk* 

i  i  \ 

Exit  scanning  procedure.1  ' 

Step  8.  Reset  k  =  k-1.  If  k  =  0,  algorithm  terminates.  Otherwise, 
reset  of  -  PjJ  +  8*. 

Exit  scanning  procedure.  ' 

Tne  heart  of1 the  scanning  procedure  lie^  in  the  tests  performed  in 
Step  3  and  Step  5.  At  each  of  these  steps  it  has  already  been  determined  ■ 
that  the,  algorithm  must  backtrack  at  least  to  variable  in  order 
to  find  the  next  eligible  partial  solution  wiich  can  possibly  lead  to  a 
completion  satisfying  (34)  If  are  fixed  in  a  partial 

L  1 

solution  (of,...  ,(  *  -j ) ,  ui>  to  (1-£*“j  Pf)  he  allocated  to  the 
oxtrene  pulrt  weigh* •  In  any  possible  completion.  Suppose 

this  is  <(' located  ir  the  mosc  favorable  way  toward  satisfying  ( 34) :.  Zero 
wigMt  woulo  he  *er  to  . .  ,p  (as  in  Step  3)  if  t  j).  And  if 

all  tne  ive'yht  ‘U,.1.  *,  :|)  would  be  assigned  to  7^  (as  in  Step  5) 
ini'  i cnt  rr;.*'i"es,  of  ci'urse,  a  test  which  is  only  a  necessary 
end :  i*-cr  f  the  :  4c>*-?e  of  i  feasible  completion  of  a  partial  solution. 
»nc  iny  ?rr)ce>:.'--e  cunsf'ucts  the  next  partial  solution  which  satisfies 
inis  tost  i 

ir.c  ir^;rtar!r,e  of  i»s  in-t  a  scanning  procedure  in  conjunction  w'th  the 

i 

none- '< nr. o  T.'-ti  oi  -  t  -  w r »  pointed  out  In  f  1 2 3 -  The  procedure 

■J;‘Cvi:  'ed  in  :h * »  sectio-.  it  Pised  on  the  scanning  procedure  used  in  the 

or  i  c,  1  rtujui- ire  Sr  At  Algorithm. 

'i  v  tor/h’ rci  fre .odur';-'  suggested  here  is  to  stop  at  the  first 
v : o » « t ««  ru'nji ndi-i;'  .v.:ns;r*ir,t,  construct  the  next  partial  solution  which 

I 

■  si.  p-,s-if)iy  t.-id  to  'i  soi.%' Jc'ciL-fi  satisfying  the  violated  constraint,  and 
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then  restart  the  enumeration  scheme  at  this  new  partial  solution.  A  possible 
variant  to  this  approach  would  be  to  use  arguments  similar  to  those  in 

Step  3  and  Step  5  to  determine  whether  this  new  partial  solution  can  possibly 

\ 

lead  to  a  completion  which  satisfies  the  nonbinding  constraints  that  have 
not  yet  been  checked. 

The  third  technique  for  taking  the  nonbinding  constraints  into  account 

is  the  elimination  of  redundant  nonbinding  constraints  at  various  points  in 

the  algorithm.  A  nonbinding  constraint  (34)  which  Is  satisfied  by  every 

subsequent  completion  within  the  n-slmplex  S  is  called  a  redundant  constraint. 

It  may  be  dropped  from  the  problem,  thus  eliminating  the  arithmetic  operations  ' 

required  to  check  it  for  feasibility. 

Redundant  constraints  are  easily  recognizable  in  the  formulation  of  the 

If  problem  which  uses  variables  p^,...,p  .  Let  C^,.  .  ^  )  be  the  best 

feasible  solution  j known  at  the  current  stage  of  the  algorithm,  and  let 

a  2  61  =  1^'  Consider  any  nonbinding  constraint  (34),  and  let  T*  a  max  . 

1  =  1  ,  r  . .  ,n 

If  T*<p,  constraint  (34)  Is  redundant,  and  if  Tt>0,  a  sufficient  condition 
for  constraint  (34)  to  be  redundant  is  that 

(35) 

After  calculating  the  right-hand  side  once  at  the  outset,  condition  (35)  would 
be  checked  every  time  an  improved  feasible  solution  has  been  generated  by 
the  algorithm. 

An  outline  of  the  skeleton  version  of  the  Accelerated  Bound-and-Scan 
Algorithm  follows.  It  incorporates  the  cone  algorithm,  the  special  procedure  for 
nonbasic  variables,  upper  bounds  on  variables,  the  scanning  procedure,  and  the 
elimination  of  redundant  constraints.  The  scanning  procedure  outline  is  used  as 
a  Subroutine  in  Step  9. 
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Outline  of  Skeleton  Algorithm 


Step 

Step 

Step 

Step 


1. 

Set 

er 

,/Bjj 

for  j  =  1 . 

,,n.  Set  B 

est  =  1 ,  Sum  =  0, 

k  =  1 

,  and 

go  to 

Step  3. 

2. 

Reset  k  ! 

*  k+1 . 

If  k>n,  go 

to  Step  8. 

3. 

If 

k<n  i 

set  p 

k  *  0  and  go 

to  Step  2. 

Otherwise  let  f  be 

k-1 

the  fractional  part  of  dk+J!^ 

Bkipi* 

4. 

If 

f  =  0 

,  set 

Pk  =  0  and  go  to  Step  2. 

Otherwise  set 

»k  -  (,-f)0k- 


Step  5-  Set  Suml  =  Sunw-pk 

Step  6.  If  Suml>Best  or  if  pk>pk>  9°  to  Step  7.  Otherwise  reset 
Sum  =  Suml  and  go  to  Step  2. 

Step  7.  Reset  k  =  k-1.  If  k  =  0,  algorithm  terminates.  Otherwise 
reset  Sum  =  Sum-p^  and  Pj<  -  pk+B*.  Set  Suml  =  SumfPk»  and 
go  to  Step  6. 

Step  8.  Check  the  nonbinding  constraints  until  one  is  found  which  is 
violated  by  (p^,...,p  ).  If  all  nonbinding  constraints  are 
satisfied,  go  to  Step  9.  Otherwise  go  to  Step  10. 

Step  9.  An  improved  solution  has  been  found.  Store  the  solution 
(pj»- • ♦ *Pn ) *  Reset  k  -  n,  Sum  =  Sum-on,  and  Best  = 

Eliminate  redundant  nonbinding  constraints  and  go  to  Step  7. 

Step  10.  Represent  the  violated  nonbinding  constraint  as 

Ii"iVi  1T- 

Set  (p^ . P*)  =  (p|,...,pn).  Enter  the  scanning  procedure.  The 

scanning  procedure  will  either  indicate  that  the  algorithm  terminates, 
or  it  will  produce  a  new  partial  solution  (pf,-..,p£).  Set 

LI 

“  (p* » •  ♦  •  »pj^)  and  Sum  —  Step  5 * 
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The  algorithm  outlined  above  Is  called  the  skeleton  algorithm 
because  It  Includes  only  the  three  simple  techniques  for  handling  the 
nonbinding  constraints:  bounds  on  variables,  the  scanning  procedure, 
and  the  elimination  of  redundant  constraints.  It  Is  suggested  that  these 
three  techniques  always  be  used.  Additional  options  which  may  be  used 
Include  conditional  bounds  on  variables  (as  discussed  In  [12]  or  In 
[5,  Ch.  VII])  and  surrogate  constraints  [7],  These  options  will  be 
further  developed  and  evaluated  In  a  future  paper 


26 


9.  Computational  Experience 


In  order  to  test  the  computational  efficiency  of  the  Accelerated  Bouno- 
and-Scan  Algorithm,  a  FORTRAN  code  was  written  for  the  IBM  360/67  system  by 
the  first  author.  The  two  main  parts  of  the  code  (1)  obtain  the  Hermite 
normal  form  of  A^  and  (2)  execute  the  Iterative  portion  of  the  aigo-ithm 
In  its  skeleton  version  outlined  in  the  preceding  sect.on  The  Hermue 
normal  form  Is  obtained  in  a  straightforward  but  relatively  inefficient  way, 
and  a  retrospective  comparison  with  the  computational  experience  (see  [3]/ 
of  Bradley's  algorithm  [1]  for  doing  this  indicates  that  rewriting  this 
part  of  the  code  could  reduce  the  executive  times  to  approximately  10%  ot 
their  current  values  The  iterative  portion  of  the  algorithm  was  encoded 
with  somewhat  more  care.  The  initial  feasible  solution  for  the  algo'-thm 
has  been  obtained  by  using  an  available  code  for  a  basic  heuristic  procedure 
developed  by  the  second  author  [13].  Part  of  the  work  required  to 
set  up  the  algorithm  (primarily  finding  the  vertices  of  the  n-simplex  %) 
is  done  by  borrowing  the  initial  part  of  the  code  for  the  Bound-and-Suan 
Algorithm  [12],  When  tabulating  computational  results,  the  total  time  -equireo 
by  the  algorithm  is  broken  into  the  following  four  components:  (1)  time 
required  by  the  simplex  method  to  solve  the  continuous  version  of  the  problem, 
(2)  Heur.  -  remaining  time  required  by  the  heuristic  procedu'e  to  nno  c  gtcd 
feasible  solution  to  inmate  the  algorithm,  (3)  Setup  -  remain. ng  t’me 
required  to  set  up  the  algorithm  ^mostly  finding  the  Hermite  norma'  fo  m  of 
A^),  and  (4)  Iter.  -  time  required  to  execute  the  iterative  portion  ot  the 
algorithm  in  its  skeleton  version 

The  code  has  been  used  to  solve  a  number  of  test  problems  taken  t •  cm 
the  literature.  These  Include  some  of  Haldi's  "t i/ed-charge  problems"  ( ft) 
and  "IBM  test  problems"  (IBM),  as  well  as  Woolsey's  5-point  "ccmbmator  ta : 


problem"  (COMB-5),  all  of  which  are  reproduced  by  Trauth  and  Woolsey  [15], 

In  addition,  the  code  was  applied  to  two  of  Petersen's  problems  [14]  (PET) 
of  the  Lorle-Savage  capital  budgeting  variety.  The  results  are  shown  in 
Table  I,*  where  the  size  of  each  problem  Is  Identified  by  m,  the  number 
of  functional  constraints,  and  n,  the  number  of  original  variables 
(excluding  slack  and  artificial  variables).  The  times  shown  in  parentheses 
are  those  that  would  have  been  obtained  if  Bradley’s  code  for  obtaining 
the  Hermlte  normal  form  of  Aj  In  a  more  efficient  way  [1]  had  been  used 
instead,  according  to  Bradley's  reported  times  [3]  on  the  same  problems,** 

Table  I  also  gives  the  available  execution  times  on  these  problems 
for  several  other  algorithms:  (1)  miller's  Bound-and-Scan  Algorithm  [12] 
run  on  the  IBM-360/67  system,  (2)  Gorry  and  Shapiro's  Adaptive  Group- 
Theoretic  Algorithm  [10]  run  on  the  IBM-360/65  system,  (3)  Gomory’s  Fractional 
Algorithm  [9]  with  Haldl  and  Issacson's  LIP  1  code  [11]***  run  on  the  IBM-7090 
computer,  as  reported  by  Trauth  and  Woolsey  [15],  (4;  Gomory's  All-Integer 
Algorithm  [8]  with  Woolsey's  IPSC  code***  [16]  run  on  the  CDC-3600  computer, 
as  reported  by  Trauth  and  Woolsey  [15],  and  (5)  Geortrion  s  Implicit 
Enumeration  Algorithm  [6]  run  on  an  IBM-7044  computer,  (A  blank  indicates 
that  no  time  has  been  reported  for  that  problem,!  Geotfrion’s  algorithm  is 
to'  the  special  case  of  0-1  variables,  so  that  (except  tor  the  Petersen 
problems)  a  binary  representation  of  the  variables  was  used  as  described  in 

*  An  attempt  also  was  made  to  apply  the  code  to  two  problems  not  shown  in 
Table  I:  (1)  IBM-4,  which  violated  the  assumption  that  the  optimal  non-integer 
solution  is  unique,  and  (2)  COMB-4,  where  the  simplex  method  obtained  an 
integer-valued  optimal  solution  so  the  algorithm  was  not  needed 

**  Bradley's  code  actually  was  run  on  a  somewhat  slower  computer  (the  IBM-7040- 
7094),  but  this  has  been  ignored  to  compensate  for  the  tact  that  Setup  includes 
slightly  more  than  constructing  the  Hermite  normal  form  of  A^. 

***These  codes  have  been  chosen  since,  according  to  Trauth  and  Woolsey's  data, 
they  appear  to  be  the  best  available  for  the  respective  algorithms. 
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[6],  His  times  were  given  In  minutes  to  two  decimal  places,  so  they  have  been 
converted  to  seconds  here  simply  by  multiplying  by  60,  except  that  his  reported 
times  of  0.01  minute  are  given  just  as  <  1  second.  It  should  be  emphasized  that 
the  algorithms  were  run  on  different  computers,  so  the  execution  times  are  not 
directly  comparable. 

TABLE  I 

EXECUTION  TIMES  FOR  STANDARD  TEST  PROBLEMS 


*  For  COMB-5,  the  heuristic  procedure  failed  to  find  a  feasible  solution  and  a  known 
optimal  solution  was  substituted,  so  Iter,  only  gives  the  time  required  to  verify  optimality. 
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In  order  to  further  evaluate  how  the  execution  time  for  the  Accelerated 
Bound-and-Scan  Algorithm  might  tend  to  vary  with  problem  sl2e  for  problems 
of  similar  structure,  the  code  also  was  applied  to  16  randomly  generated 
problems.  Four  of  these  were  "Type  III"  problems  used  previously  by  the 
second  author  to  test  his  heuristic  procedures  [13]  and  Bound-and-Scan 
Algorithm  [12]  (approximately  1.5  seconds  total  were  required  for  the  simplex 
method,  a  heuristic  procedure,  and  this  algorithm  on  each  of  these  problems). 
The  other  12  are  new  "Type  V"  problems  whose  parameters  are  integers  randomly 
generated  from  the  Intervals  indicated  In  Table  II 

TABLE  II 

DESCRIPTION  OF  THE  RANDOMLY  GENERATED  TEST  PROBLEMS 


Problem  type 

III 

V 

CJ 

[0,99] 

[0,5] 

a1J 

[0,1] 

[0,5] 

b1 

1 

10  for  V-l  to  V-9 

20  for  V-10 

40  for  V-l  1 

80  for  V-l 2 

The  computational  results  for  these  problems  are  given  in  Table  III,  Since  the 
problems  proved  to  be  "too  easy"  for  the  Iterative  portion  of  the  algorithm, 
the  most  Interesting  results  are  the  setup  times  and  their  very  stable 
dependence  on  problem  size 
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TABLE  III 

EXECUTION  TIMES  FOR  RANDOMLY  GENERATED  TEST  PROBLEMS 


Problem 

m 

i 

n  , 

LP 

Heur. 

Setup 

— 

Iter. 

TOTAL 

1 1 1-2 

15 

j 

15 

0.55 

0.15 

2.14 

0,01 

2.85 

III -4 

15 

is; 

0.60 

0.13 

2  12 

0  01 

2  86 

III -5 

15 

,5 1 

0  57 

0.10 

2,10 

00, 

2.78 

1 1 1 -8 

15 

15 

0  61 

0.16 

2,15 

0  01 

293 

V-l 

5 

5 

0-05 

0.03 

0.24 

0  00+ 

0.32  | 

V-2 

5 

10 

0.07 

0.08 

0.70 

i  0  64 

1.49 

V-3 

5 

15 

0.11 

0.14 

1.41 

0  03 

1.69 

V- 4 

5 

20 

0.13 

0.13 

2,40 

;  O-OOt 

2  66 

V-5 

5 

25 

0.23 

0.29 

4.03 

0  05 

4  60 

i 

V- 6 

5 

40 

0.23 

0.70 

11.25 

007 

IT  25  i 

V-7 

10 

15 

0.31 

0.11 

1-83 

o 

o 

2  26 

V-8 

20 

15 

1.47 

0,33 

2  62 

0.01 

4  42 

1 

V-9 

,  40 

15 

6.91 

0.22 

5,28 

0  03 

12  44 

v-in _ — wv-4-tc-- 

0  31 

I  0.20 

1.80 

1  0  03 

i 

2.34 

v-n 

1  10 

15 

0.29 

0,20 

1  80 

\ 

0  03 

1 

2  32 

V-l  2 

|  10 

!  15 

I 

0.30 

0.19 

1  79 

j  0.03 

2.31 

10-  Conclusions 

A  basic  consideration  motivating  both  the  Bound-and-Scan  and 
Accelerated  Bound-and-Scan  Algorithms  is  the  availability  of  heuristic 
procedures  such  as  those  developed  by  the  second  author  [13].  The 
heuristic  procedures  normally  can  find  a  very  good  (frequently  optimal) 
feasible  solution  extremely  quickly.  Since  the  number  of  better  feasible 

solutions  should  be  relatively  small,  an 
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optima]  solution  can  then  be  identified  efficiently  if  these  better  feasible 
solutions  can  be  directly  enumerated  In  an  efficient  way  Both  algorithms 
are  carefully  designed  to  attempt  to  efficiently  enumerate  a  sequence  of 
improving  feasible  solutions  until  no  better  ones  remain.  Computational 
experience  obtained  from  unrefined  computer  codes  of  simple  versions  of  these 
algorithms  has  been  encouraging  to  the  authors,  suggesting  that  this  basic 
approach  may  have  considerable  potential- 

The  Bound-and-Scan  Algorithm  constructs  each  new  improved  feasible 
solution  by  successively  assigning  appropriate  integer  values  to  the 
variables,  beginning  with  the  variables  that  are  nonbasic  in  the  optimal 
linear  programming  solution  and  concluding  with  the  basic  variables.  The 
construction  procedure  for  the  nonbasic  variables  is  extremely  efficient,  and 
it  generates  only  those  partial  solutions  which  have  improved  completions 
(perhaps  non-integer)  that  satisfy  all  of  the  binding  constraints  (5).  On 
the  other  hand,  the  procedure  for  the  basic  variables  is  much  lec  efficient, 
ana  it  can  generate  "excess"  partial  solutions  having  no  such  improved 
completions  The  Accelerated  Bound-and-Scan  Algorithm  attempts  to  rectify 
this  by  using  a  transformation  of  variables  that  may  increase  the  number  of 
nonbasic  variables,  and  that  also  allows  applying  a  slight  modification  of 
the  procedure  for  nonbasic  variables  to  the  basic  variables  This  tends  to 
greatly  accelerate  the  iterative  portion  of  the  algorithm  *  The  price  that 
is  paid  for  this  acceleration  Is  the  extra  setup  time  to  perform  this 
transformation  by  constructing  the  Hermlte  notmal  form  This  extra  time  is 
faiilywell  predictable  However,  as  indicated  in  Tables  1  ana  ill,  this 

*  An  acceleration  Is  not  guaranteed,  however,  since  the  transformation  of 
variables  can  Increase  the  computational  effort  required  to  generate  the 
same  completions,  e.g.,  by  generating  a  value  of  B,  tor  i  -  n,0  that 
is  tremendously  larger  than  those  for  i  >  n^fl 


32 


setup  time  Is  significant  for  problems  of  moderate  size  (even  recognizing  that 
the  times  given  are  an  order  of  magnitude  larger  than  necessary  with  the  best 
available  procedure  and  code).  Furthermore,  If  the  elements  01  are 
large,  then  the  code  for  constructing  Its  Hermlte  normal  form  may  fail  because 
of  overflow.  Therefore,  the  Accelerated  Bound-and-Scan  Algorithm  should  not 
automatically  be  preferred  to  the  original  Bound-and-Scan  A-gonthm 

Available  comparative  computational  experience  is  given  in  Table  I 
It  appears  that  the  current  code  for  the  skeleton  version  ot  the  Accelerated 
Bound-and-Scan  Algorithm  Is  at  least  competitive  with  the  other  algorithms, 
and  this  would  be  even  more  true  if  the  best  available  code  were  used  tor 
the  setup  (see  the  times  In  parentheses)  However,  it  has  often  been 
observed  that  there  probably  will  never  be  an  Integer  programming  algorithm 
that  is  superior  to  all  others  on  all  problems,  and  that  certainly  continues 
to  be  the  case  here.  The  apparently  best  available  codes  (according  tu 
Trauth  and  Woolsey's  data  [15])  for  Gomory's  Fractional  and  All-Integer 
Algorithms  performed  better  on  some  of  the  difficult  problems.  The  Gorr,y- 
Shaplro  algorithm  tended  to  be  slower  on  the  easy  prubelms  but, 
unfortunately,  a  meaningful  comparison  is  not  possible  since  Gorty  and 
Shapiro  did  not  report  any  times  on  the  standard  difficult  problems 
Geoffnon's  algorithm  was  an  Impressive  performer  on  a  slower  computer 
It  continues  to  appear  that  a  good  0-1  algorithm  (and  this  is  a  very  good 
one)  should  tend  to  be  superior  to  a  general  algorithm  on  a  0-1  problem, 
or  perhaps  even  on  a  general  integer  programming  problem  having  very  small 
upper  bounds  on  the  variables.  A  comparison  with  the  Braole>-Wahi 
algorithm  for  the  cone  problem  has  been  given  in  Section  7 

However,  one  extremely  important  current  advantage  cf  the 
Accelerated  Bound-and-Scan  Algorithm  over  the  others  is  that  its 
computation  time  can  be  quite  accurately  estimated  in  advance  for  any 
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given  problem.  The  first  author  [4]  presents  methods  for  doing  this,  as  well 
as  establishing  upper  bounds  on  computational  effort,  in  a  companon  paper 
Therefore,  the  user  can  learn  In  advance  whether  this  algorithm  will  solve 
his  problem  In  a  reasonable  length  of  time  or  another  algorithm  should  be 
tried  instead. 

Another  attractive  feature  of  this  algorithm  is  that  it  is  primal 
in  nature  It  starts  with  a  good  feasible  solution  ana  then  successively 
rinds  better  ones.  Therefore,  if  the  algorithm  must  be  terminated  before 
completion,  a  near-optimal  solution  wl 1 i  still  be  provided 

These  two  features  suggest  another  interesting  possibility  to-  the 
use  of  this  algorithm  Suppose  that  the  estimated  execution  time  tor  a 
given  problem  Is  excessive,  and  it  appears  that  the  same  may  be  true  tor 
other  available  algorithms  as  well  (perhaps  because  the  problem  is  large 
without  special  structure)  If  the  optimal  solution  .s  only  slightly 
better  than  the  feasible  solution  provided  by  heuristic  procedures,  then 
't  may  not  be  worth  a  long  compcter  run  to  try  to  improve  upon  this 
feasible  solution  Therefore,  the  Accelerated  Bcund-and-S.an  Algorithm  can  be  used 
instead  to  find  the  optimal  so'ution  only  if  it  is  s.bstantia' iy  better . 
ana  otherwise  verify  that  it  is  not  This  is  done  s  mply  by  setting  some 
strictly  positive  lower  bound  kq  on  the  values  pq  tnat  will  be 
considered,  so  that  the  algorithm  will  seek  only  feasible  solutions  x 
such  that  c^x  _  pq[c^x^®^  -  c^V^],  whe.*-  ,s  the  feasible 

solution  provided  by  heuristic  procedures  and  x^  is  the  optimal  solution 
to  the  linear  program  (1,2,3)  If  pq  15.  significantly  greater  than  zero, 
this  can  reduce  execution  time  dramatically 

There  remain  a  number  of  important  possibilities  for  improving  and 
generalizing  the  Accelerated  Bound-and-Scan  Algorithm  (or  the  Bouna-and-Scan 
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Algorithm)  that  are  being  Investigated  by  the  authors.  These  Include  the 
additional  options  for  the  algorithm  mentioned  at  the  end  of  Section  8 
Also,  the  ordering  of  the  rows  of  A-|  can  greatly  affect  computational 
effort  by  changing  the  relative  magnitudes  of  the  for  1  >  n-j ,  and 
the  Implications  of  this  are  being  studied.  The  algorithm's  assumption 
that  x<°>  Is  unique  Is  an  unfortunate  restriction,  and  some  ways  of 
eliminating  this  restriction  are  being  explored,  Including  those  proposed 
for  similar  algorithms  by  the  second  author  [12]  and  by  Bradley  ana  wahi 
[3],  Finally,  high  priority  will  be  placed  on  extending  the  algorithm 
to  the  mixed  Integer  linear  programming  problem 
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STRACT,  ■ 

XV  •  •  . 

This  paper  presents  a  new  Implicit  enumeration  algorithm  for  solving  the 
pure  Integer  linear  programming  problem.  The  theory  of  equivalent  Integer 
programming  problems  Is  first  used  to  reformulate  the  problem.  A  technique, 
originally  used  with  particular  success  In  the  bound-and-scan  algorithm  to 
deal  with  only  a  subset  of  the  variables.  Is  extended  to  all  of  the  variables 
In  the  restructured  problem.  In  addition  to  the  resulting  basic  enumeration 
scheme,  the  algorithm  Includes  a  scanning  procedure  and  a  method  for 
Identifying  constraints  which  become  redundant  during  the  course  of  the 
algorithm.  Computational  experience  on  standard  test  problems  Is  reported.^ 
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